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ABSTRACT 

Student appraisal of faculty instructional 
competencies is commonplace. .Although several logics account for / 
sponsorship of student evaluation schemes^ the ultimate product of 
student evaluation ought to be improved instruction. The purpose of 
this paper is to investigate relationships ^between student evaluating 
and better teaching.^ A mandatory system of student assessment of \ 
teaching* skills employed at Bowling Green University is the frame of 
reference. -If student ratings contribute to better teaching^ ratings 
should imptcove over time. .Regression equations and standards tests 
were employed to determine the existence of trend increments. 
Findings reveal ;bhat regression coefficients of regression equations 
were- as low. as O..By inference^ student evaluation had not 
contributed to better teaching. . Shortcomings in the adHiinistratiop of 
the evaluation scheme and faculty attitudes^^ and capabilities account 
for^apparent failures of the scheiAe to result in improved teaching. 
Appendices include , related, research material. (Author) 
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ABSTRACT 
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Student appraisal of faculty instructional competencies is commonplace. 

Although several logics account for sponsorship of student evaluation 

i • * * 

schemes, the ultimate product of student evaluation ought to be/ improved 
instruction. The purpose of this paper is to investigate rela^tionships 
between student evaluating and better teaching. A mandatory ^system of , 
student assessment of teaching skills employed at Bowling Gr^een University 
is the frame of reference. v. , ' -.-^ 

If student ratings contribute to better teaching, ratings should 
improve over time. Regression equations and standard t tests were employed 
to determine the existence of trend increments. Findings^ reveal that 
regression coe^icients of regression equations were as Tow as" 0. By 
Inference, -student evaluation ha<l not contributed to better teaching.' 

Shortcomings in the administration of the evalWtion scheme and 
faculty attitudes and. capabilities account for apparent failures of the 
-scheme ta-result -in-improved-teachingr ^ 
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. DOES STUDENT EVALUATION 
STIMULATE IMPROVED TEACHING? 



Over the past several years, student evaluation of faculty instructional 
competencies has become fashinable in academe. ' A variety of factors account 
for institutional acceptance of the student evaluation concept. Evaluation ' 
schemes may be viewed as a device to provide faculty insights about their 
abilities ti)*help students learn or. the purpose of student evaluation may be 
tied to tKe- reward system — that is, "evaluation results are used to document 
claims foij additional benefits. Regardless of the motives for acceptance, we 
would, nevertheless, expect the ultimate product of student evaluation to be 
an ^improvement in teaching effectiveness. This is to say that the real test 
of student evaluation has to do with an improvement in teaching effectiveness 
o^^er time. 

The pur-Dose of this paper is to gauge the impact student assessments 
of faculty instructional skills on , the improvement^ of teaching effectiveness 
(as inferred from student evaluation results over time). Research draws upon 
experiences and empirical' data associated with student evaluat?ioa at the. 
College of Business Administration, Bowling Green State University. 

•k. . . I _ - . ■ .• 

THE "BOWLING GREEN" PLAN 
Student assessment of teaching skills became mandatory at the College of 
Business Administration in 1969. ^This action followed faculty approval of 
the evaluation concept and definition of a rating^scheme. (See Appendix A) 
In succeeding years, faculty have reaffirmed the principle of student evalua- 
tion of instructors and ^continued us^ of the original plan. 

\ . . . 
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The/ evaluatid^ instrument emplo^fedLjLn the "Bowling Green" scheme is 
"^pen-ended" - that is, students arfe requested to describe .their instructors' 
S^^engths or shortcomings, to identify approaches which ^might contribute to * 
improved performance^ and to assign a particular grade '(A-A, B-3, C-2, D-1, 
or F-0). The grades assigned provide an index of performance. Open-ended 
evaluation forms (rather than structured-, multiple, response types of instru- 
ments; were adopted in order to permit students the opportunity to "tell it 
as it is" - to provide evaluators degrJes of freedom to define for themselves 
what constitutes effective teaching; hi it the personal qualif -.s of the 
:^tructor or learning outcomes. Moreover, because the open-ended instrument 
[lows students maximum freed^I^ to describe what "turned them on (or off)/' 
!e form is thought especially helpful to faculty as.gyides to self -improvement. 
Administration of the student evaluation scheme within the College of 
Business is a shared responsibility of the Dean's Office, Departmental Chairmen, 
faculty, and students. The Office of the'Dean is charged with logistical 
aspects of the program which consist primarily of distributing and collecting 
evaluation instruments, .recording ratings, developing College and Departmental 
performance indices, and forwarding folfms to appropriate Department Chairmen. 
.Departmental Chaifmen and/or senior faculty,, using evaluations as feedback 
instruments, counsel faculty about approaches to exploit strengths or to repair 

shortcomings. The ^ystem is designed to promote the counseling function, 

■» 

specifically as it relates to the attempts to assist junior faculty become more 
effective teachers. ^Faculty are'lcijsponsible for assuring students that their 
participation in the ev aluation -process will got affect academic standings. To 
insure the integrity of the scheme, faculty .are absent when students complete 
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evaluation instruments durine the last week of classes, students do not 

>• 

identify themselves on forms, and faculty may, review instruments only after 

finaJL grades have been deposited* with the Registrar. Students, for their 

I 

part, are expected to participate in the program in a responsible and honest 

manner. In order 'ito generate greater student participation^in the evaluation 
•process, the .Dean's Advisory Council (a group consisting of the undergraduate' 

leadership of honorary societies ^and professional organizations in the College) 
J each quarter addresses 'letter^ to students prior to the distribution of 

evaluation instruments, requesting genuine cooperation. 

II . 

HAS TEACHING EFFECTIVENESS IMPROVED? ; 

If student evaluation contributes to an improvement in teaching effiective- 

ness, 'presumably students would acknowledge improvements by assigning faculty 

• * ■■• ■ , ■ y 

higher ratings. Reflections of improvement should take the form of (at least) 

a gradual increase in the overall average value of ratings received by faculty. 

This is not to say that improvements will become fevident from one period to 

the next. Faculty may be unable to react immediately to feedback, or the 

identiW between effective teaching and the pay-off^ system may ^e unclear so 

that percteived inducements do not act as motivators. Existence of a lead-lag 

relationship between student evaluation and improved performance of (say) two 

periods, hence, would seem reasonable. Expectedly, the average College "grade'' 

of 2.8 over time would tend toward 3.0 and beyond. 

, In order to develop an uttderstanding of the effect of evaluations upon 

faculty instructional performance over time, regression equations using the 
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:quarcc vCiJc ucveijopeci ror two'^taculty groups. . Moreover, 
using a standard t test we sought; to determine whether regression coefficients 
were significant. 'Our hypotfhesisj was that coefficients were equal to zero 
^ (Ho: B=0) - that is^ no trend increments existed - by way-of inference, 
teaching effectiveness had not improved. In applying these methodologies, 
we assumed that the criteria employed by students to judge teaching effective- 
ness r^ained unchanged and application of criteria over evaluation periods 
was uniform. 

Group A consists of 50 teachers who were members of the College of 

Business Administration facul^ty at the time student evaluation was Intro- 

duced. Winter Quarter 1969-1970, and have participated in the program all 
« 

eight quarters. Instructional skilLe of this group w^re evaluated by 
22,141 students who were" members of IjOOJTcourse offerings. Members of 
firoup B are 13 faculty who joined the Colle^in Septem'ber 1970 and have 
taught during six consecutive quarters. Group B "grades" reflect the assess- 
ments of 4,317 students enrolled in 195 courses. Excluded from these groups 

V 

are faculty who were not assigned instructional responsibilities for all 
. quarters under consideration, who left Bowling Green after Winter Quarter 
1969-1970, or who are Fall 1971 additions. By segmenting, faculty according 
to the scheme described above, it was thought that the* (potentia^l) impact of 
student evaluation upon teaching effectiveness might be better observed. To 
illustrate - faculty who joined the College September 1970 received (for the 
most part; appointments at lower academic ranks, accepted the concept of a 
mandatory student evaluation system, and were coramit^ted to instructioii of 
undergraduate programs. 



Averages or scuaent cvci-^tlcn tcr Uroui^o A and o are aescribed below. 

\ 

EXHIBIT I . > 

, MEAN VALUES^ 

• • . (BY GROUP AND QUARTER) ^ ' 



Quarter 


■ A 


B 


Wi^nter 1969-1970 


2.83 


r 


Spring 1969-1970 


.. 2.90 




Fall 1970-1971 


2.75 


2.79 


Winter 1970-1971 


2.88 


• 2.79 


Spring '1970-1971 


2^98; 


. 2.97 


Fall 1971-1972 


2.86 


2.99 


Winter 1971-1972' 


•2.72. 


2.97 


Spring 1971-1972 


. '2.91 


^- 3.09 


Total period 


2.88 


i.93 



iTotai "quality points" (A=4, B=3, C=2, D=l, F=0) for each course offering *" 

1 1 

for each faculty member /total student evaluations. 



Result^ of the test for significance appear in Exhibit II. 



Group 
A 
B 



' t 



'1.3000 
.8169 



EXHIBIT II 
TEST FOR SIGNIFICANCE-'^ • 

Critical Value;(= .01 DF 
3.143 • 6 
3.747 4 



D ecision on Ho 
Accept 
Accept 



^See Appendices. B and C for method and calculati^ons. 



On the basis of test results we accept the mill hvn^^hAQ^c that- y-^^ 

\ 1 ' " 

i 

gression coefficients 6f our regression equations are as low as 0. We 
conclude, therefore, that because the overall value of student ratings has 
not increased, student evaluation has not resulted in an improvement in 
teaching effectiveness. 

III 

IMPLICATIONS 

The evaluation system employed at Bow^ling Green appears to have failed 
to stimulate an overall improvement in teaching. ' The question at hand then 
is what factors account for apparent failure of the teacher evaluation 
scheme to stimulate improyed instruction? From our viewpoint, shortcomings 
in the overall administration of the student evaluation program and faculty* 
capabilities and attitudes are factors which primarily account for the seeming 
inability of student evaluation to 'promote teaching effectiveness. ' 

Before we discuss these factors, we need to re-exapiine our original 
assumption that student perceptions about faculty instructional performances 
are constant. The assumption may be invalid due to the possibility of changes 
'in student expectations of teaching competencies. Students who have partici- 
pated in the evaluation process for several quarters, for 'example, may now 
reguire more from their -teachers and^, therefore, might become more critical 
in their evaluation of performance. The possibility exists, then, that while 



teaching effectiveness may have improved it might not have been recorded as 
evaluators became harsher critics. AJ. though we have reviewed thousands of 
Student responses to questions asked on the evaluation form and, in turn. 



..«v«= a^Huxicu sume reel tcr rt'-cnt judgrutuL* about; ettective teaching, we 
do not believe sufficient information' exists in order to affirm or deny the 
assumption of constant expectations. ' 

The evaluation, scheme assumes counseling relationships- between faculty 
and Departmental Chairmen. Chairmen and/or "master" teachers are expected 
to assist faculty who receive low ratings to become mote competent in the 
classroom. Although some Chairmen and faculty have worked diligently to *' ' 
Kelp colleagues (especially junior members) become more effective teachers, 
indications are that neither counseling nor joint development of instructional 
skills is practiced .widely. In some cases, little attention is directed to 
•counseling activities because the concept of student evaluation of instructors 
is not accepted and, in other situations, efforts directed to the sharpening 
and honing of teaching skills is thought to be a high cost/low reward acti- 
vity - in essence, some jmay perceive improved teaching 'efforts as performance 

i 

punishing activities. 

Good teaching is rewarded - in fact, recommendations for merit salary ^ , 
increases and promotions must be -documented by results o^ student evaluation. 
■Nevertheless, student evaluations have only recently served as inputs to 
decisions regarding defiiiition of rewards (Group A - 1969-1972; GroupB - 
1970-1973). Chairmen and the College's administration could do more. to demon-' 
strate the relatiotjship between teaching, excellence and rewards. To illustrate: 
use of Management by Objectives ffs a joint (faculty-Chairman) goal determination 
and appraisal technique in place of the traditional scheme of faculty evaluation 
and allocation of rewards'may be desirable to assist faculty develop' and perceive 



tea'-ning improvemertt as perforaance non-nimishing (rewarding) anf-f 

Resul-fs of student evaluation of instructors are not made public. 
Student assessments are sejen only by the College's administration, the . 
assessed faculty jhember, and his Department Chairman. One reasptTfor i 
restricting this information is that interpersonal comparisons may lead 
to conflict situations among faculty. But, of greater import, student 
evaluation is keyed to self -improvement. 

The initiative to seek assistance from colleagues, as a means- to self- 
improvement and self -development must come from the faculty member. In 
•I 

. general, faculty are reluctant to seek the help of'their colleagues. Senior " 

faculty tend hot) to ask for help from Junior faculty members who are recog- 
J, nized for their teaching ability because of status relationship's associated 
with rank, age,, and tenure differences. 

Another attitudinal influence is that senior faculty are charged with 
the respo^nsibility of evaluating overall performance of jpnior faculty. 
This relationship is .perceived ^y some faculty (in particular, non-tenured 
members) to operate contrary to the development of mutual trust and confidence. 
In addition, the academic environnient tends to stress individual contributions. 
a--tendenc/ which may frustrate atteanpt's at team building and "interdisciplinary 
efforts to promote greater teaching effectiveness. ' ^ 
i* With respect to the notion of faculty capabilities a€ a constraining 

influence upon the impt'ovement of teaching effectiveness, we mean simply that 

> 

le faculty do not possess the potential to markedly improve 'their perfor- 
mance. Students from one period to the next rate the collective College 
teachitir-s^ort as a "solid" B. We interpret this rating to mean that, as a 
vhole, faculty are rendering fine contributions to the learning process - it 



^.v ^4.-.v.,w w»»^o. pcrfcrmaiVwc uibcrepancy , 

(desired -actual) is not; significant enough to indicate existencfe of perfor-^ 
mance problems A First of all, we cannot expect faculty already achieving 



\ 

high ratings ' 



(say) 3.5 and above to enhance the value of their teadhing. 

\ ' ', ' ■ A ■ 

Further, we belieVd that it is difficult, via student ratings, for ^avioral 
\ changes to occur iA some faculty who, over time, were not effective teachers 
6iit, in terms of self -appraisal, perceived or rationalized- that they helped 
students learn. Beha-^ioral change occurs slowly and the eight quarter and 
sl3^^'^arter evaluation periods for groups "A" and "B," respectivWly, may not? 
. be sufficiently long enough for faculty learning and experimentation results ' 
•to be observed. \ /' 



/ 

/ 



I \ CONCLUSION ' /'""^ ■ . 

■ ' /■ 

The student evaluation Wstem employed at Bowling Green appears not to 



be effective - although student evaluation of instructional skills m^y have 
helped^some members of the faculty to become better teachers, frckn an .aggre- 
gate point of view it does not^appear that* the evaluation scheme has resulted 
in Improved teaching. Experiences with student evaluation at the College of 
Business should not*, however, become arguments against the evaluation concept. 
The potential of.student assessment of faculty ^nstructional competencie;B to 
help faculty create a b/atter envirorpent for learning still appears to be , 
significant; Realization of this potential," nevertheless,- is dependent upon 
the improvement of Department Chairman- faculty counseling relationships, 
distribution of greater rewards ^r effective teaching, a change in attitude 
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describe approaches to improve perfonnande^ and' faculty* ex^^loitation of 

1 • , .1 

skil'^ deficiencies'.. It appears the shortcomings of this scheme relate to 

I ^ \ > ■ • ' 1 • . . 

fabulty perceptions of the importance of teaching performance and administra- 



results of an evaluation system. Student .evaluation dois identify 



ti^e activities -to help remove dbstacle^^ creating an environmentvcphducii^;- 



T 

to |mproving, teaching >etfectiveness. 



c 



r 




K&rl E. Vogt and Harry. Lasher _ 
College of Business Administration 
Bowling Green State University 
Bowling Green, Ohio 43403 
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APPENDIX A 

COLLEGE OF BUSINESS ADMINISTRATION 
Bm/ling Green Sc&te University 
Bowling Green, Ohio 43403 



STUDENT EVALUATION OF INSTRUCTOR 



JURSE NUMBp AND TITLE^. 
' INSTRUCTORIS NAME 



The 'faculty members of the College* of Business Administration have 
voted to hxse student evaluations because Jthey feel that through" these 
• evaluations teaching competence can be. improved. Consequently, .you are 
being asked to grade your instructor on his overall tcachfng effectiveness, 

' ' [ ' ^ ■ ^ . - 

Indicate in a brief statement the factors which you consider signifi- 
cant about the instructor of this course. 



J 



How do you believe this instructor .could improve his/her teaching 
effectiveness? 



Please circle the letter grade which you assign to this instructor. 



(Excellent) 



B 

(Good) 



(Average) 



D • - p 
( Poor) ( lins at is f ac t ory ) 



HOfTE: THE JESUITS OF: THIS RATIMG BY STUDENTS WILL NOT BE MADE KNOIW TO 
^ TKE. INSJCRUCTOR UNTIL AJPTER FINAL GRADES HAVE BEEN RECORDED, 



~" ' \ . APPENDIX B • 

^^ttidftnt- Kva1ii«f-fnn of Fprtilty Tnctntrf -tonal Competencies Hars Not 
Resulted In An Improvement In Teaching Effectiveness Over Time 

(Group A) 

MODEL = a + e^' 



TEST . 5 0 



b = «zxy..(ix)(i:y) . ^=Y.bx 



X / 

(Quarter »in Transforming (Grade P6^.nt Average Of \ 

• Units) V. Student Evaluations) ^ 

■ 0 , 2.83 XX = ?8 

1 2.90 IZY = 23.03 

"^2 . ' 2.75 ' * (ZX)2 = 784 

•3 ' ' 2.88 ZX^ = 140 

4 ' 2.98 Zy^ j= 66i3303 

5 . 2.86 ZXY = 81.15 
: 6 ' 2.92 

•7 2.91 



8 (81. 15) -28 (23. 03) 



^'36 = ,0130 



8 (140) -784 ^ 
i [23.03-.0130(28)| «=. 22.6660 = 2.8332 



Yj = 2.8332 + .0130Xj|^ 



i^." 0 At Winter Quarter, 1969-1970 



t « b-e 



Sfc - Sy.x -.l/z Y^-aZY-bZXY \/ 66.3303-2.8332p.03)-0130(81.15) 

Z- V,;^ -n;;^^, = y/ 3|6 I^AT 



y.OOOL-?^^ — 

t - ^0130-0 . 
' ..01 

t.99(6)«3.143 

DECISION:, -.ACCEPT H^, (REGRESSION NOT SIGNIFICANT) 



no 



APPENDIX C 



Student Evaluation of Faculty Instnictional Competencies Has Not 
Resulted In An ImprovemeuL lu TeacuJLiig cf f ecciveness Over Time 

(Group B) 

MODEL Yj. = a + BXi + e^^ 



: e > 0 



NEX^ - (EX)^ 

« 

X . . Y 

(Quarter in Transforming' (Grade Point Average of 

. • Units)' Student Evaluations) 



0 2.79 EX = 15 

1 . 2.79 EY = 17.62 

2 2.97 (EX}2 "= 225 

3 2.99 , EX^ = 55 

4 , t, 2.99 Ey2 = 51.8174 
I 5 3.09 EXY =- 45.11 

b\ 6(45.11)-(15) (17.62) = 5^ 05,0 
6(55) - 225 • 105 

a= ^ [17.62- .0510(15)] = 17.5435 \, 2.9239 ' 

* » 

Y. « 2.9239,+ .0510X4 » 

• i . "1 . - , 

i «= 0 At Fall Quarter, 1970-1971 . 

ySY^-aEY-bEXY y 5L. 8174-2 . 9239 (17 . 62 ) - . 0510 (43UlT 



6 



^^"^ - • ' 003897 » .06243 * 



f 



17.5 \/ • ^ 

♦0510-0- » .8169 
.06243 • 



t 99(4) « 3^747 



DECISION: , ACCEPT H^^ (REGRESSION IS N&T SIGNIFICANT) 



